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Abstract 

1 We generalize the notion and some properties of the conic function introduced by Vincze and 

. Nagy (2012). We provide a stochastic algorithm for computing the global minimizer of generalized 

conic functions, we prove almost sure and ^'-convergence of this algorithm. 

1 Introduction 

> 

Let K be a compact body in M? (a compact set coinciding with the closure of its interior) and consider 
\^ \ the distance function induced by the taxicab norm. The so called conic function Fk associated to K 
(introduced by Vincze and Nagy [9, Defintion 6] , see also Definition 12. ip measures the average taxicab 
distance of the points from K via integration with respect to the Lebesgue measure, or explaining in 
another way: the conic function Fk at some point (x, y) £ R 2 can be interpreted as the expectation 
of the random variable defined as the taxicab distance of (x,y) and (£,f?), where (£,7?) is a 
uniformly distributed random variable on K, for more details see part (ii) of Remark 12.11 Conic 
functions are extensively used in geometric tomography since they contain a lot of information about 
unknown bodies, for a more detailed discussion see Gardner [5] and Vincze and Nagy [5]. We recall 
that one of the striking features of the conic function Fk is that a point in M 2 is a global minimizer 
of Fk if and only if it bisects the area of K, i.e., the vertical and horizontal lines through this point 
cut the compact body K into two parts with equal areas, see Vincze and Nagy [91 Corollary 1]. We 
call the attention that points with similar properties are important and well-studied in geometry. For 
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instance, we mention that if S is a convex set in R 2 , then there exist two perpendicular lines that 
divide S into four parts with equal areas, see Yaglom and Boltyanskii [lOj Section 3]. 

In Section [2] of the present paper we generalize the conic function Fk introduced by Vincze and 
Nagy [9j in a way that it measures the average taxicab distance of the points from K via integration 
with respect to some measure [i on K with n{K) < oo, see Definition 12.21 From geometric point 
of view the body K associated with some measure [i can be considered as a mathematical model 
of a non-homogeneous body and hence our generalization of conic functions may find applications in 
(geometric) tomography where typically non-homogeneous bodies occur. We generalize Theorems 3, 
4, 5, Lemmas 6, 7 and Corollary 1 in Vincze and Nagy [9] for conic functions Fk „ associated with 
a compact body K and a measure fi with fi(K) < oo. We only mention that it turns out that a 
point in M 2 is a global minimizer of Fk :I m if and only if it bisects the /i-area of K, see Corollary 

In Section [3] we give a stochastic algorithm for the global minimizer of the convex function Fk^- 
In the heart of our algorithm the well-known Robbins-Monro algorithm (see [8]) lies, and we prove 
almost sure and L 9 -convergence of our algorithm. More precisely, we define recursively a sequence 
(Xk)kez + of random variables (see f)3. 1 [) ) which forms an inhomogeneous Markov chain and we prove 
almost sure and L 9 -convergence of this Markov chain via Robbins-Monro algorithm, see Theorem l3.2i 
We also prove almost sure and L 9 -convergence of the sequence (-^^(Xfc^fceN) see Theorem 13.31 
In general, stochastic algorithms for finding a minimum of a convex function have a vast literature, 
see, e.g., Robert and Casella [7J and Bouleau and Lepingle [i2j. Without giving an introduction of 
the newest results in the field we only mention the paper \1\ of Arnaudon et al., which in some sense 
motivated our study. They gave a stochastic algorithm which converges almost surely and in I? to 
the so-called p-mean of a probability measure supported by a regular geodesic ball in a manifold. 



2 Generalized conic functions 

Let Z+, N, R and M + denote the set of non- negative integers, positive integers, real numbers and 
non- negative real numbers, respectively. For an i£l 2 , we will denote its Euclidean norm by ||x||. 
Let K C M 2 be a non-empty compact set such that it coincides with the closure of its interior. In 
geometry K is called a compact body. By B{M. d ) and B(K), we denote the Borel cr-algebra on 
R rf and on K, respectively, where d G N. For all x, y G M let us introduce the following notations 

{K <i x} := {(a,/3) G K : a <x}, {x <i K} := {(a,/3) G K : x < a}, 
{K < 2 y} := {(a,/3) G K : (3 < y}, {y < 2 K} := {(a,/3) G K : y < /3}, 
{K = x x} := {(a,/3) GK:a = x}, {K = 2 y} := {(a,/3) G K : /3 = y}. 

The notations {K x}, {x K}, {K ^2 y} and {y ^2 K} are defined in the same way. 

Next we recall the notion of a generalized conic function associated with K due to Vincze and 
Nagy [9]. 

2.1 Definition. (Vincze and Nagy [9], Definition 6]) The generalized conic function Fk : M 2 — >■ M 
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associated to K is defined by 

Fx{x,y) := . * / di((x,y),(a,/3))dad/3, (x,y)eM. 2 , 
A \ K ) Jk 

where A(K) is the 2- dimensional Lebesgue measure (area) of K, and the distance function d\ 
is given by d\{(x, y), (a, /3)) := \x — a\ + \y — /3\, (x,y),(a, j3) £ M 2 (d\ is known to be the metric 
induced by the taxicab norm). 

The next result is about the global minimizer of Fk- 

2.1 Proposition. (Vincze and Nagy [9, Corollary 1]) A point in R 2 is a global minimizer of 
the generalized conic function Fx if and only if it bisects the area of K, i.e., the vertical and the 
horizontal lines through this point cut the compact body K into two parts with equal area. 

We note that the global minimizer of the generalized conic function Fk is not unique in general. 
In Proposition 12.21 we give a sufficient condition for its uniqueness. 

In what follows we will frequently use the following conditions 
(C.l) K is connected, 

(C.2) V-{B{p,e) n K) > for all p £ K, e > and B(p,e), 

where \i is a measure on the measurable space (K,B(K)) and B(p,e) denotes the open ball around 
p with radius e, and 

(C.3) //({if =i a?}) = fi({K = 2 y}) = for all x, y € R. 

We call the attention that Condition (C.3) does not hold for a measure in general. For example, if \i 
is the distribution of a discrete random variable having values in K, then Condition (C.3) does not 
hold. However, if [i is the 2-dimensional Lebesgue measure on K, then Conditions (C.2) and (C.3) 
hold automatically (indeed, since K is a non-empty compact body, its interior is non-empty). 

2.2 Proposition. If Condition (C.l) holds, then Fk has a unique global minimizer [x* ,y*) G M 2 , 
and F K (x,y) > F K (x*,y*) for (x, y) / (x*, y*), {x,y)eR 2 . 

Proof. The existence of a global minimizer of Fk can be checked as follows. By Theorem 3 in 
Vincze and Nagy [9], Fk is a convex function defined on M. 2 and its level sets are compact subsets 
of M 2 . Hence Fk is continuous and consequently it reaches its minimum on every compact set. 

Now we turn to prove the uniqueness of (x*,y*). Let us suppose that (x*,y*) £ M? and 

(x*,y*) £ M 2 are global minimizers of Fk such that (x*,y*) ^ (x*,y*). Then x* ^ x* or y* ^ y*. 

We may assume that x* < x*. Then both of the vertical lines M? =i x* and M 2 =i x* bisect the 
area of K. Let us consider the open half-planes 

H* := M 2 <i x* and H* := M 2 >i x*. 

Note that (x*,y*)eH* and (x*,y*) E H*. We show that K n [H* n H*) = 0. On the contrary, 
let us suppose that there exists p £ R 2 such that p £ K n (H* n H*). Since if is a non-empty 
compact body, there exist 

< e < mm{d 2 (p,M. 2 = x x*),d 2 (p,M. 2 =i J*)} 
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and q G B(p,e) such that q is an inner point of K, where d 2 denotes the standard Euclidean 
distance on R 2 . Hence there exists 

< 5 < mm{d 2 {p,M. 2 =1 x*),d 2 (p,M. 2 =1 x*)} 

such that B(q,6) C K D (H* n H*). Then 

A(if <i 5*) = A(z* <i iO ^ A(B(g, 5)) + A(x* <i iT), 

(2-1) 

A(x* <i K) = A(K <i x*) ^ A(S(g,(5)) + A(if <i x*), 

and hence 

A(K <i x*) ^ 2A(S(g, + A(K <i x*), 

i.e., ^ A(i?((7, 5)), which yields us to a contradiction. Hence K n (-ff* fl fl"*) = 0. Note that for 
deriving (|2.ip we hiddenly used that Condition (C.3) holds for the 2-dimensional Lebesgue measure, 
and the inequality ^ A(B(q,5)) yielded us to a contradiction since Condition (C.2) holds for the 
2-dimensional Lebesgue. Let < rj < (x* — x*)/2, and let us consider the open half-planes 

I* := R 2 >i x* - T] and I* := K 2 <i? + rj. 

Then I* and I* are open sets of M 2 , 1*0 1* = 0, and, since K n (H* n ff*) = 0, we have 
K C I* U J*. Further, /* n if and I* DK are separated sets such that their union equals K. This 
is a contradiction due to the connectedness of K. Hence x* = x*, and in a similar way we have 

y* = y*. □ 

We call the attention that Condition (C.l) is sufficient but not necessary in order that the gener- 
alized conic function Fk should have a uniquely determined global minimizer. Figure Q] shows three 
different cases where Condition (C.l) is not satisfied but Fx has a unique global minimizer. 




Figure 1: Examples for K such that Condition (C.l) does not hold but Fx has a unique global 
minimizer. 

On the right subfigure of FigureHJ the circles have centers (— l/\/l2, 0) and (l/2 n , 0) with radii 
l/\/l2 and l/2 n+2 , respectively, where n e Z+. 

2.1 Example, (i) If K is the square with vertexes (0, 0), (0, 1), (1, 0), (1, 1), then 



Fk{x,v) = 




(x,y) G K, 



see, e.g., Vincze and Nagy (9J Example 3]. The global minimizer of Fx is (x,y) = (g, \)- 
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(ii) If K is the triangle with vertexes (0,0), (0, 1), (1,0), then 

F K (x, y) = -^(x 3 + y 3 ) + 2(x 2 + y 2 ) - (x + y) + -, (x, y) G if. 

Indeed, Fk(x, y) = E(|£ — x|) + E(|ry — y|) for all (x,y)Gif, where (£,r/) is a uniformly distributed 
random variable on K. Then the joint density function of (£, rj), and the density functions of the 
marginals of (£, 77) take the forms 



and 



2 if (a,/3) G if, 
if (a, /3) if, 



\-2a + 2 if a G [0,1], f_ 2 /3 + 2 if /? G [0,1], 

\0 if a [0,1], MJ \0 if P# [0,1], 

respectively. Hence for all (x,y) G i*T, 

rl rx rl 

E(\£-x\)= / |a-x|(-2a + 2)da = / (x - a)(-2a + 2) da + / (a - x)(-2a + 2) da 

JO Jo Jx 

= -^x 3 + 2x 2 -x + i 

and similarly E(|ry — y\) = — |y 3 + 2y 2 — y + | for all (x,y) G if. Hence the global minimizer of 
Fk is (1 — v2/2, 1 — v2/2). Indeed, the solution in if of the system of equations 
(?i^> 

— -(x,y) = -2x 2 +4x-l = and — -(x, y) = -2y 2 + 4y - 1 = 0, 
ox ay 

is (1-^/2/2,1-^/2). 

In what follows we generalize the notion of the conic function introduced by Vincze and Nagy [9J 
Definition 6], see also Definition 12.11 

2.2 Definition. Let [i be a measure on the measurable space (K,B(K)) such that /i(if) < 00. 
The generalized conic function Fk u : R 2 — > R associated to if and fi is defined by 



F K ^(x,y):= di((x,y),(a,/3))/i(da,d/3), (i,y)er. 
Jk 

2.1 Remark, (i): Note that under the conditions of Definition [22] we have FK t u(x,y) is well-defined 
for all (x,y) G R 2 , since for fixed (x,y) G R 2 , the function K B (a,/3) h-> di((x,y), (a, f3)) is 
bounded and /j(if) < 00. 

(ii): If /i is a measure on K such that /-t(if) < 00 and it is absolutely continuous with respect to 
the Lebesgue measure on if with Radon-Nikodym derivate h^, then 

Fk,ix(x,v)= di((x,y),(a,P))hf t (a,P)dadp, (x,y)GR 2 . 
Jk 



With 



1 if (a,/3) g'if, 
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we have Fk,^ coincides with Fk- Note also that the conic function Fk given in Definition 1 2 . 1 1 can 
be interpreted as the expectation of an appropriate random variable. Namely, 



F K (x,y) =E[di((x,y),(£,r ? ))], (x,y)el 2 , 
where (£, rj) is a uniformly distributed random variable on K. □ 

Next we generalize Theorems 3, 4 and 5, Lemmas 6 and 7 and Corollary 1 in Vincze and Nagy [9] 
for the generalized conic function Fk,h- 

2.1 Theorem. The generalized conic function Fk u '■ K 2 — > K+ is a convex function which satisfies 
the growth condition 

liminf F k ^ x ^ > l'(F) > 
|[(x,v)||->oo ^J x 2 + y 2 

Consequently, the level sets of the function Fk,u are bounded and hence compact subsets of M 2 . 
Proof. Recall that 

FK,n( x >y)= d i(i x ,y), (a,£))jti(da,d/3), (x,y)eIR 2 . 
•/if 

The convexity of Fk u is clear, since the integrand is a convex function for any fixed element 
(a, f3) £ K, and the Lebesgue integral with respect to the measure \i is monotone. Further, since 
d 2 ((x, y), (a, (3)) $C d±((x, y), (a, /?)), (x, y), (a, (3) £ M 2 , where d 2 is the standard Euclidean distance 
on M 2 , we have 



K 



and then 



\J x l + y £ JK \ V x + V J 

The triangle inequality shows that 

\A 2 + y 2 = d 2 ((x, y), (0, 0)) < d 2 ((x, y), (a, (3)) + d 2 ((a, (3), (0, 0)) = d 2 ((x, y), (a, (3)) + Va 2 + /3 2 , 
and then 



%^4> / Mda,d/3), (x,y)GlR 2 , (z,y)^(0,0). 



By Fatou's lemma, 



FK tt i(x,y) 



liminf 7= 9 > J im '* ni / 1 / „ I M(d«,d/3) 

(a;.wll->-oo \/r + y z \\{x,y)\\->°° JK V 



x/« 2 


+ /3 2 




+ y 2 


x/« 2 


+ /3 2 



^/ liminf ( 1 - + £ ) //(da, d/3) = //(if) > 
J k \\( x >y)\\^°° \ yx 2 + y 2 l 
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Here for completeness we note that one can use Fatou's lemma, since for all c > 0, 

^inf jl - ^== : \\(x,y)\\ > c| //(da,d/3) = (l - V<* 2 + ff^ M ( da>d/8) > ^ 

where the last inequality follows by that if is compact (hence bounded) and /t(if) < oo. 

Let d G M.+ and let us suppose that the level set {(x,y) G M 2 : FK :fJl (x,y) ^ d} is unbounded. 
Then one can choose a sequence (x n ,y n ), n G N, such that FK^(x n ,y n ) ^ cZ, n G N, and 
II (x n ,y n ) || = oo- This would imply that 

lim ^ A^Vn ) = Qj 

which contradicts to the growth condition. □ 

2.1 Lemma. Ze/ ns suppose that Condition (C.3) holds. For the generalized conic function Fk,^, 
we have 

Fk,h( x > V) = x (Ai K <i x }) - Ai x <i - / «( 1 {a<a ! } - 1 { 2; <a}) M da > d/3) 

+ y (//({if < 2 y}) - //({// < 2 if})) - j P(l {p<y} - l {y<j8} ) //(da, d/3), (x, y) G M 2 . 

Proof. By definition, 

F K ^(x,y)= f (|x-a| + |y-/3|)//(da,d/3), (x,y)GlR 2 . 

JK 



Here 



/ |x — a| //(da, d/3) = / |x — a| //(da, d/3) + / |x — a| //(da, d/3) 

JK< x x Jx^K 

= / (x — a) //(da, d/3) + / (a — x) //(da, d/3) 

JK< 1 x Jx^iK 

= x(//({if <i x}) — //({x if })) — / a //(da, d/3) + / a //(da, d/3), 

Jk<!X Jx^iK 



and the integral 



y-/3|//(da,d/3) 



can be handled similarly. The assertion follows by taking into account Condition (C.3). □ 

2.2 Lemma. Let us suppose that Condition (C.3) holds. For the generalized conic function Fk,^, 
we have 

D 1 F K>fl (x, y) = //({if <! x}) - //({x <! if}), (x, y) G M 2 , 
D 2 F K ^(x, y) = //({if < 2 y}) - //({y < 2 if}), (x, y) G M 2 . 
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Proof. Let h > 0. Then for all (x, y) £ 



Fk,h{x + h,y) - F K ^(x, y) 



K 



\x + h — a\ — \x — a\ 
h 



\x + h — a\ — \x — a\ 



//(da, d/3) + 



K<\x 



//(da, d/3) 

\x + h — a\ — \x — a\ 



h 



//(da, d/3) 



+ 



\x + h — a\ — \x — a\ 



x+h<iK 



h 



/i(da, d/3) 



x + h — a — (x — a) 



//(da, d/3) + 



K< x x 



x^iK^ix+h 



x + h — a — {a — x) 
h 



//(da, d/3) 



+ 



/ 



a — x — h — (a — x) 



//(da, d/3) 



A' 



//({if <i x}) 



\x + h — a\ — \x — a\ 



x^iK^ix+h 



h 



//(da, d/3) - //({x + h <i if}). 



Using that ||a| — ^ \a — b\, a, b £ R, for the integrand we have 



\x + h — a\ — \x — a\ 



h 



^ — \x + h — a — (x — a) 



\h\ 



1, x,a £ R, h > 0, 



and hence, by dominated convergence theorem, 
f \x + h — a\ — \x — a\ 

Ix^K^x+h 



h 



■ //(da, d/3) 



\x + h — a\ — \x — a\ 



h 



//(da, d/3) 



' x^iK^ix+h 

^ //({x if x + /i}) //({if =i x}) = 



as /i — >• 0. Then 

FkA x + Ky) ~ FK,fi{x, y) 

(2.2) 



lim ■ 



h 



//({if <i x}) - //({x if }) 



//({if <i x}) - //({x <i if}), (a?, y) € 



Similarly, if h < 0, then 

gj^pE + h,y) - Fjq^x, y) 
h 



//({if <i x + /i}) + 



|x — ot\ — \x + h — et\ 



x+h^iK^ix 
2 



h 



//(da, d/3) 



- //({x < x if}), (x,y)£ 
and hence, using again Condition (C.3), 

//({if x}) - //({x <i if }) 



ii m Fk A x + ^> y) ~ f kA x i y) 



(2.3) ht0 

= //({if <i x}) - //({x <i if}), (x, y) G R 2 . 

Then and ([13]) yield that D^K^x^y) = //({if < l x}) - /i({x <i if}), (x,y) G R 2 . 

In a similar way, we have D2Fk,h(x, y) = /J>({K <2 y}) — ^{{y <2 if}); (x,y) £ R 2 . 



□ 



If // is a measure on (M d ,B(R d ), then by the //-area of a Borel measurable set 5 G B(M. ), we 
mean //(S). 



2.1 Corollary. Let us suppose that Condition (C.3) holds. A point in R 2 is a global minimizer of 
the generalized conic function Fk a if and only if it bisects the Li-area of K, i.e., the vertical and 
the horizontal lines through this point cut the body K into two parts with equal Li-areas. Moreover, 
if Conditions (C.l) and (C.2) hold too, then Fk,h has a unique global minimizer (x*,y*) 6 R 2 , and 
F K ^(x,y)> F KtfM (x*,y*) for (x, y) + (a?*, y*), (x,y)£R 2 . 

Proof. First note that under Condition (C.3) the concept of bisection of the /U-area of K is well- 
defined. The first part of the corollary is a consequence of Lemma 12.21 using that a local minimum of 
a convex function defined on R 2 is a global minimum, too. Under Conditions (C.l), (C.2) and (C.3), 
the existence of a global minimizer (x*,y*) of Fk,u follows by that Fk,u is a convex function 
defined on R 2 and its level sets are compact subsets of R 2 (see Theorem 12. ip . Indeed, a convex 
function defined on R 2 is continuous and it reaches its minimum on every compact set. Now we 
turn to prove the uniqueness of (x*,y*). The proof goes along the very same lines as in the proof of 
Proposition 12.21 Indeed, the area A has to be replaced by the measure li. □ 

Before we generalize Theorem 4 in Vincze and Nagy [9] we need to introduce some notations and 
to recall the Cavalieri principle for product measures. 

2.3 Definition. Let lii and \ii be a-finite measures on (M.,B(M)) and let ll := li\ x ll 2 be 

their product measure on (R 2 ,,6(R 2 )). Given a measurable set S £ B(M. 2 ), the generalized X-ray 
functions with respect to S and li into the coordinate directions are defined by 

Xs,n{y) '■= V>i(Sy)> ye*> and Y s ^(x) := li 2 (S x ), x £ R, 

where S x := {y G R : (x,y) £ S} and S y := {x E R : (x,y) £ S}. (Note that S x ,S y £ B(R) for 
all x,y £ R, see, e.g., Lemma 5.1.1 in Cohn \^.) 

For the product measure \i defined in Definition 12.31 we have n{K) < 00. 

2.2 Theorem. (The Cavalieri principle, see, e.g., Cohn [4, Theorem 5.1.3]) Let fi\ and ^2 

be a-finite measures on (M.,B(M)) and let \i := \i\ x \ii be their product measure on (R 2 ,£>(R 2 )). 
If S £ B(M?), then the functions Xsn,Ys tfl : R — > R + are Borel measurable, and 

n(S) = Gm x &)(S) = [ Ys^Wmidx) = I XsMvzi&y). 

Jm Jr 

2.3 Theorem. Let K,K* C R 2 be compact bodies, let fii, fi*, i = 1,2, be a-finite measures on 
(R,S(R)) ; and let /i := fi\ x fj,2 and /j,* := x fx^ be product measures on (M? , B(M?)) such 
that jj, is supported by K and fj,* is supported by K* , respectively. Let us suppose that Condition 
(C.3) holds for K and li, and K* and li* , respectively. Then Fk u = Fk* a* if and only if 
XK,n(y) = XK*,n*(y) for almost every y £ R, and Yk^(x) = Yk* for almost every 

i.e., the corresponding generalized X-ray functions corresponding to K and li and K* and li* , 
respectively, coincide almost everywhere. 
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Proof. By Theorem 12.21 (the Cavalieri principle), 

/x roo 
YkA s ) /"i( ds )> n(x<iK)= Y K ,p(8)ni(ds), xel, 
-oo J X 



I X 

f oo 



(2.4) 

v ' py poo 

^{K< 2 y) = X K ^(t)n 2 (dt), fi(y< 2 K)= X K>ll (t) Ma(dt), yG 

J — oo ./ y 

and, by Fubini's theorem, for all xjER, 

p px p poo 

/ atlf a<x \n(da,dl3) = / sYk iM (s) //i(ds), / alf x<a \ n(da,d/3) = sY K ,^(s) /ii(ds), 

J-oo J^sT Ji 

(2.5) 

p py p /*oo 

f31 v<y}f i(da,d(3)= tX K ^(t) » 2 {dt), f3l {y<0} »{da,df3) = tX K ^(t) M2 (di). 

Indeed, for example, the first statement of (|2.5p holds since, by Fubini's theorem for non-rectangular 
regions, 

I al {a<x} n(da,df3) = [ ([ al {a<x} /x 2 (d/3) ) /Ui(da) = / al^^}^^) Mi(da) 
= al {a<x} Y K ^(a) ^(da) = sY K ,n(s) Mi(ds), 

where 

a 6 := inf {a | 3/3 G R : (a,/3) G ET}, a u := sup {a | 3 (3 G R : (a,/3) G if}, ET a = {/3| (a,/3) G if}. 
Further, by ()2.4|) . Lemma 12.21 and Lebesgue differentiation theorem, 

DiDiFj^nix, y) = 2Yk^(x) for all y G R and almost every x G R, 
(2.6) D 1 D 2 F K ^x,y) = D 2 D 1 F Kjtl (x,y) = for all (x,y)GR 2 , 

D 2 D 2 FK tfM (x,y) = 2Xx^(y) for all x G R and almost every ?/ G R. 

Let us suppose that -Fa> = Fr*^*. By (|2.6|) . we have Yft-^(x) = Yft-* iM *(x) for almost every 
x G R, and Xx,^{y) = Xk*^* (y) for almost every y G R, as desired. 

Conversely, let us suppose that Xx iM (y) = XK*,[i*(y) for almost every y G R, and Yft- jM (x) = 
Yk*,[i*(x) for almost every x G R. Then, by Lemma |2~T1 (j2.4j) and ()2.5|) . we get Fk^ = Fk*,^*- □ 

2.2 Remark. Note that, under the conditions of Theorem 12.31 f° r almost every (x,y) G R 2 , the 
matrix consisting of the second order partial derivatives of Fk^ takes the form 

2Y K>fM (x) 

2X K ^(y)\ ' 

which is a positive semidefinite matrix. Note also that this is in accordance with the fact that F^n 
is a convex function due to Theorem 12.11 □ 

Before we generalize Theorem 5 in Vincze and Nagy [9]j we need to recall some notions. 
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2.4 Definition. Let K be a compact body in M 2 . For all e > 0, the outer parallel body K £ is 
the union of closed Euclidean balls centered at the points of K with radius e > 0. 



2.5 Definition. The Hausdorff distance between two compact bodies K and L is given by 

H(K, L) := mm{e > : K C L £ and Lc K £ ). 

2.3 Lemma. Let K n , n £ N, K be compact bodies, and let n be a Radon measure on (M?,B(M?)). 

(i) We have lim e | KK £ ) = fJ.(K). 

(ii) If K n — > K as n — > oo with respect to the Hausdorff metric H, then the following regularity 
properties are equivalent: 

(a) lining n((K \ K n ) U (K n \ K)) = 0, 

(b) limn—^oo 

Proof. The proofs go along the very same lines as those of Lemmas 1 and 2 in Vincze and Nagy [9] 
by replacing the area A by the measure \x in the proofs and refereeing to that /jl(L) < oo for all 
compact sets L CM? (due to that \i is a Radon measure). □ 

2.6 Definition. Let K n , n £ N, and K be compact bodies, and let \i be a Radon measure on 
(M?,B(M. 2 )). The convergence K n — > K as n — > oo with respect to the Hausdorff metric is called 
regular if one of the conditions (a) and (b) of part (ii) of Lemma \2. 3\ holds. 

2.4 Theorem. Let K n , n G N, and K be compact bodies, and let /j, be a Radon measure on 
(M?,B(M. 2 )). Let us suppose that the convergence K n — >• K as n — > oo with respect to the Hausdorff 
metric is regular. Then 



Proof. The proof goes along the very same lines as that of Theorem 5 in Vincze and Nagy [9], but 
replacing the integration with respect to the two-dimensional Lebesgue measure by the integration 



For the remaining sections of the paper we will need some further properties of the convex function 
Fk,u- Next we recall some general facts from the theory of convex functions, see, e.g., Polyak [61 
Lemma 3, Section 1.1.4]. 

2.4 Lemma. Let F : M d — > R be a differ entiable and convex function such that its gradient is 
Lipschitz continuous with constant L > 0, i.e. 



lim F Kn ^(x,y) = F KjfM (x,y) 



{x,y)eR 2 . 



with respect to the measure fi. 



□ 



(2.7) 



grad F(jp) — grad -F((/)|| ^ L\\p — q 



p,qe M . 



Then we have an affine lower bound 



F(q) ^ F(p) + (grad F(p),q 



P) 
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2.5 Lemma. Let \i\ and (j,2 be a-finite measures on (R, i3(R)) that are absolutely continuous 
with respect to the Lebesgue measure on (R, B(R)) with bounded Radon-Nikodym derivatives. Let 
[i := [i\ x H2 be their product measure on (R 2 ,£>(R 2 )) and we assume that \i is supported by K. 
Further, let us suppose that Condition (C.3) holds. Then the generalized conic function Fk,^ '■ R 2 — >• R 
associated with K and \x satisfies the conditions of Lemma \2.4\ and, consequently, we have an affine 
lower bound for F^^- 

Proof. By Theorem 12.11 Fk a is convex. Under Condition (C.3), by Lemma 12.21 and (12. 4ft . 

/x roo 
Yk,ii(s) m (ds) - / Y K)fl (s) fii(ds) 
-00 J X 

POD 

^(s)/i(s)/ii(ds)- / y^( S )/i( S )/ii(ds), (x,y)GR 2 , 

) 1/ X 

where f\ denotes the (bounded) Radon-Nikodym derivative of fi± with respect to the Lebesgue 
measure on R. Using that the integral as a function of the upper limit of the integration is continuous, 
we have F)\Fk^ is continuous on R 2 . Similarly, one can check that -C^-^if,^ is also continuous on 
R 2 . This implies that Fk^ is differentiable on R 2 . 

Condition (|2.7p for can be checked as follows. Let us start with the difference of the partial 



derivatives with respect to the first variable 

DiF K ^( q ) - DxFkM = K K <i <z {1) ) - Kq (1) <i K) - {h{k <i p (1) ) - Kp {1) <i k)) 

for all p = (p^\p^), q = (q^\q^) G R 2 , where the equality follows by Lemma 12.21 We have 
H{K <i g {1) ) = n(K <i min{pW, gW}) + ^(min^ 1 ), gW} <i if <i gW) 

and 

p(g (1) <i if) = ^(max{pW,gW} <i if ) + /i(g {1) <i if <i max{p (1) , gW}). 

Of course we can change the role of q and p to express fi(K <i p^) and //(p^ <i if) in a similar 
way. Then 

DiF K ^(q) - D x F K ^{p) = fi(mm{p^,q^} < x if <i g«) - /i(g« <j if < x max{p« gW}) 

- M (min{pW,gW} <x # <1 p «) + <x # <x max{pW,gW}). 

Hence we can see that if p^ = mm{pW, gW} and, consequently, g*- 1 ** = maxjp^ 1 ^, g 1 - 1 ^}, then 

DiF K ^(q) - D X F K M = 2/z(p« < x if < a g«). 
If gW = minlp' 1 ' , gW } and p^' = maxjp' 1 ), g*- 1 -*}, then 

D 1 F Ktlt (q) - D 1 F Kt(t {p) = -2 M (g« < t if < x p«). 

In general, 

\DiF K ^{q) - D\Fk,h{p)\ = 2/i(min{p( 1 ),g( 1 )} < x if < x max^ 1 ', g«}). 
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Therefore, using Theorem 12.21 (the Cavalieri principle), we can estimate the difference of the absolute 
value of the first order partial derivatives as follows 



\D 1 F K ^(q)-D 1 F K>fl (p)\^2 Y Kt(t (s) m(da) 



i{pW,(;W} 
' min{p( 1 ) ,qW } 

C 2 (supY^(s) ) Mi((niin{pW } gW},max{pW,gW})) 





supF^(s) / /i(s)ds 

sGR / Jmm{pW,qW} 



with some constant C\ > 0, where sup sgR Yk^(s) < oo (since n(K) < oo), and /i denotes the 
bounded Radon-Nikodym derivative of fi\ with respect to the Lebesgue measure on R. Similarly, 

I-D^mC?) - D 2 FkAp)\ < 2C 2 f supX^i)^ |p( 2 ) - g ( 2 >| 

V*gR / 

with some constant C2 > 0. Therefore 



||grad F KjM (p) - grad F x , M (g)|| ^ <J {DxFrM ~ D 1 F Kifl (q))^ + {D 2 F Ktfl {p) - D 2 F K ^(q)) 2 

<L\\p-q\\, P ,qeR 2 , 

where 



L := 2 max < Ci sup Yr-^(s), C2 supX^ iAt (t) > 



i.e., condition (|2.7p for -Fr;^ is satisfied with d = 2 and with the Lipschitz constant L given above. 
□ 



3 A stochastic algorithm for the global minimizer of Fr^ 

We provide a stochastic algorithm for computing the global minimizer of generalized conic function 
Fk u introduced in Definition 12. 2\ and we prove almost sure and L 9 -convergence of this algorithm. 

In this section we assume that 

(C.4) fi is a probability measure on K. 



Let (ifc)fcGN be a decreasing sequence of positive numbers such that ^fc = 00 an d Y^k=\^k < ~ 



00. 



Let (Pfc)fcGN be a sequence of independent identically distributed (2-dimensional) random variables 
such that their common distribution on (R 2 , B (R 2 ) ) is given by fx. Let xq € K be arbitrarily 
chosen. We define recursively a Markov chain (X k )k<=z + by 

(3.1) X := x , and X k+X := X k - t k+1 Q k+1 , k G Z+, 
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where 



Qk+l 



if XU^PM and Xf >P fc % 



if and 4 2) << } , 



if ^<P« and 



if X«<P« and 4 2) << } , 



with the notations X fc := (xf^X^), P k : = (P fc (1) , P fc (2) ), fc G N. 



3.1 Remark. Note that if /j, is a probability measure on K such that it is absolutely continuous 
with respect to the Lebesgue measure on K with Radon-Nikodym derivate (density function) 
given by 

if (x,y) G K, 







if (x,y) K, 



then (Pfc)fcgN is a sequence of independent identically distributed (2-dimensional) random variables 
such that their common distribution is the uniform distribution on K. □ 



3.1 Almost sure and L 9 -convergence of {X k ) k€ z + 

First we recall the so-called Robbins-Monro algorithm based on Bouleau and Lepingle j2j Theorem 
B.5.1, Chapter 2]. This algorithm (in dimension 1) was originally invented by Robbins and Monro [8]. 

Let d G N and {Pq, 9 G be a collection of probability measures on (M d , B(M. d )), and let 
(t n )n€Z + be a decreasing sequence of positive real numbers. Let us suppose that all the random vari- 
ables introduced below are defined on a probability space (fi, P, P). The Robbins-Monro algorithm 
generates a sequence of Revalued random variables (9 n ) n& z + given by the recursion 

9 n +l := 9 n + *n+l(/? — Cn+l), n G Z+, 

where (3 G R d , and #o is a given Revalued random variable. The (conditional) distributions of the 
d-dimensional random variables (£n)nez + are given by 

P(£ n+1 G B | P n ) := P e „(P), n G Z+, P G 0(R d ), 

where the filtration (P n )«ez + is defined by Po := c(#o) an d P n := cr(0 o , 9\, ■ ■ ■ , 9 n , £i, . . . , £ n ), 
n G N. In other words, for all n G Z + the conditional distribution of with respect to the 

cr-algebra P„ is defined to be Pg n . 

The following assumptions will be used. 

Assumption (A.l): The Revalued random variable 9q belongs to L 9 (fi,P, P), where g G N. 

Assumption (A. 2): There exists some B > such that [|£ n [| ^ P for all n ) 2, n £ N. 
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Assumption (A. 3): There exists some 9* G M. d such that for each e G (0, 1), 



inf ( 

e<||0-0*||<l/s 



e*,M{o)-p) > o, 



where M : M d — ^ IR rf is a Borel measurable function such that E(£ n+ i | T n ) = M(9 n ) holds P almost 
surely for all n G N. 

3.1 Theorem. [Almost sure and ^-convergence of Robbins-Monro algorithm] Let us sup- 
pose that Assumptions (A.l), (A. 2) and (A. 3) hold and that the decreasing sequence (t n ) n( z% + of 
positive numbers satisfies 

oo oo 

tk = oo and ^~]tl +1 < oo. 

k=0 k=0 

Then P(lim n _^ 0O 9 n = 9*) = 1 and lim^oo E \\9 n — 9*\\ q = for all gSN. 

Note that under Assumptions (A.1)-(A.3) the point 9* G M. d exists uniquely due to that, by 
Theorem 13. 1\ P(lim n ^. 0O 9 n = 9*) = 1 and the limit of an almost surely convergent sequence of 
random variables is unique (up to probability one). 

We will prove almost sure and L 9 -convergence of the recursion given in (I3.ip . But first we present 
an auxiliary lemma. 

3.1 Lemma. Let us consider the sequence (Xk)kez + defined by (|3.ip . Let us suppose that Conditions 
(C.3) and (C4) hold. Then 



(3.2) 
and 



E(Q i |X i _ 1 ) = grad^(Xi_ 1 ), i G N, 



E{X k ) = x -J2tiE(gradF K>fl (X^i)), k G N. 



1=1 



Proof. First note that 



Xk = x - ^2 tiQi, k G N, 



i=i 



where the sequence (Qi)igN is such that the conditional distribution of Qi with respect to Xj_i is 
given by 



(3.3) 



= < 



with probability n({(x,y) G K : x\ l \ > a?, x\% ^ y}), 



with probability fJ.({(x,y) G if : X^ ^ x, X^ < j/}) 



.(2) 



with probability fi({(x,y) G K : X^i < X^ ^ y}), 



with probability (i({(x,y) G if : X^ < x, Xf\ < y}) 



,(2) 
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Then 

nQi\*i-i) 



1 //({(*, y) G if : X« > x, xf\ > y}) + ( 1 j M ({(x, y) G if : > x, X^ < y}) 



1 



-1, 



+ 



1 



' M ({(x,y)Gif :X« <x, xf\>y})+( ]) M ({(x, y) G if : X« < x, X^ < y}) 



,(2) 



1, 



= M{(x,y) G K : x\ X \ > x}) - M ({(s, y) G if : X^ < x}) 
" ^({(^y) G * : X\% > V}) ~ Ki(x,y) G if : < y}) / 

_ / M (if ) - 2»({(x, y) G if : X« < x})\ 
" l^(if) - 2 M ({(x,y) G if : xg < y})) ' 
Note that, by Condition (C.3) and Lemma \2.2\ we also have 

(d f (x (1) x (2) )\ 

E(Q 4 1 Xi-i) = 1 JT, 1 ' = gradi^X^), i G N. 

Hence the expectation of X/% takes the form 

k k k 

E(X fc ) = x - ^tiE(Qi) = x - Y^tiMHQi \Xi-i)) = x - ^t i E(gradF^(X i _ 1 )), k G N. 



(i) 



i G N. 



8=1 



1=1 



□ 



3.2 Theorem. Let us suppose that Conditions (C.1)-(C4) hold. Then the sequence of 2- dimensional 
random variables defined in (|3.ip converges almost surely and in L q (q G NJ to £/ie unique global 
minimizer X* of the generalized conic function F% i.e., P(lim n _ >0O X n = X*) = 1 and 
lim n _, oo E||X n -X*||9 = 0. 

Proof. First note that under Conditions (C.1)-(C.3) there exists a unique global minimizer 9* of 
F Ktll , and F K ^{9) > F K ^{9*) for all 9 9*, 9 £ M 2 . Let us apply Theorem O with the following 
choices: 

• d := 2 and {-P# : G K 2 }, where P# is the distribution on (IR 2 ,£>(R 2 )) of the discrete random 
variable having values 



with probability fi({K < 9^} n {if < 9^}) , 

with probability /x({K < 0W} n {<9( 2 ) < if}), 

with probability ^({# (1) < K } n {if < # (2) }), 

with probability fi({9^ < if } n {0 {2) < if}), 
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where 9 := (0M,0( 2 )). 

• := G M 2 , and £„+i := Q n+ i, n G Z+. 

• 6>* G M 2 is such that gradF^ iAt (6»*) = G E 2 . Note that under the Conditions (C.1)-(C.3), by 
Corollary 12. 1\ 9* is unique, and it is nothing else but the unique global minimizer of Fk 

In what follows we check that Assumptions (A.1)-(A.3) hold. Assumption (A.l) holds trivially. As- 
sumption (A. 2) holds with B := \/2, since 



1 



1, 



-1 



1 



V2. 



By ([321), we have M : M 2 M 2 , Af(0) = gradFjr, M (0), G M 2 , and, by Corollary EH 

M(0*) = grad F Ktli (0*) = € I 2 . 

Finally, for Assumption (A. 3) we have to check that for all e G (0, 1), 

r,gradF^(0)> >0. 



inf ( 

EsS||0-0*||<l/e 



Since Fk^ is a convex and differentiable function defined on 
of Lemma 12.51) , we have 



(see, Theorem 12.11 and the proof 



(3.4) 



(gradF^(0),0* 



FkA ) < 0. V # G 



where the last inequality follows by that 9* is the global minimizer of Fk,^, see also Lemma 12.41 
Since 9* is strict global minimizer of F K ^, i.e., F K ^(9) > F K>fJ ,(P*) for all 9 / 9*, 9 G M? (see 
Corollary 12. ip . by (|3.4p . we get Assumption (A. 3). □ 

3.2 Remark. Let AT be the square with vertexes (0, 0), (0, 1), (1,0), (1, 1) as in part (i) of Example 
12.11 Let us assume that fi is the probability measure on K with Radon-Nikodym derivative with 
respect to the Lebesgue measure given by 



1 if (x,y) G K, 
if {x,y)£K. 



Further, let x :=(0,0) T and t k := \, k G N. Then 

( o\ k k 1 



An 



k G N, 



i=l 



i=l 



where the sequence (Qi)ieN is such that the conditional distribution of Qi with respect to Aj_i is 
given by (13. 3p . By Theorem 13.21 and part (i) of Example 12. 1\ we have P(lim/ C _ i . 00 X k = X*) = 1 and 
lim^ooE \\X k - A*||9 = for all q G N, where X* = (1/2, 1/2) T . Note also that if AVi G K, 
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then the conditional distribution of Qi with respect to Xi—i takes the form 



Qi = < 



with probability x\ l \x\% 



with probability X^\{1 - xf\), 



with probability (1 - x\ l \)x\% 



with probability (1 - xf\){l - xf\) 



Finally, we remark that X 1 = (1, 1) T and X 2 = (1/2, 1/2) T . 



□ 



3.2 Almost sure and L 9 -convergence of (i 7 V,^(- 5 Gc))fcez+ 

First we recall an equivalent reformulation of L^-convergence, where q G N, see, e.g., Chow and 
Teicher (3J Theorem 4.2.3]. 

3.2 Lemma. Let d,q G N, £ : — > M. d and £ n : — > M. d , n G N, oe M. d -valued random variables 
such that ~E(\\t;\\ q ) < oo and E(||£„[| 9 ) < oo, n G N. T/ien £ n converges to £ in L q as n->oo 
('i.e., lim^^oo E([|£ n — ^H 9 ) = Oj j/ and onfo/ «/ £ n converges in probability to £ as n — > oo and 
i/ie set of random variables {\\£, n \\ 9 : n € N} is uniformly integrable, i.e., 



lim sup E 



»n[| 9 l{||$n||*>m} 



)=0. 



3.3 Theorem. Let us suppose that Conditions (C.l)-(C.^) hold. Then the sequence of one- 
dimensional random variables (i 7 A',^(^A;))fceN converges almost surely and in L q (q G N) to 
Fk,h(X*) as k — > oo, where X* denotes the unique global minimizer of Fk,h- 

Proof. By Theorem EE2 P(lim fc ^ oc X fc = X*) = 1, and hence to prove that P(limj( ! _). 00 Fjc^Xf.) — 
Fk,u[X*)) = 1, it is enough to check that Fk„ is continuous. This follows by that i*if 1(U is a convex 
function defined on M? (see Theorem 12. ip . We give an alternative argument, too. Let (x n ,y n ) G M 2 , 
n G N, be such that lim ri _ ) . 0O (x n , y n ) = {x,y), where (x,y) G M 2 . Then for all (a, /3) G M 2 , 
linin^oo di((x n , y n ), (a, /?)) = di((x, y), (a, and, using that K is bounded, 

sup sup di((x n ,y n ), (a,/3)) < oo. 

n€N(o,/3)Gi : s: 

By Lebesgue dominated convergence theorem (which can be used since fJ,(K) < oo) 

lim F K Jx n ,y n ) = / lim di((x n , y n ), (a, /3)) n(da, d/3) = / di((x, y), (a, (3)) //(da, d/3) 

= F K> n(x,y), 
yielding that Fk^ is continuous. 
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Further, using Lemma 13.21 and that almost sure convergence yields convergence in probability, in 
order to prove L 9 -convergence of (.F J K - , /i (X'A:))fceN> it is enough (and actually necessary) to check that 

(3.5) lim su P E(||X fe || 9 l { || Xfe ||, >m} ) =0. 

m ~ > °° feeN 

We show that the sequence (H^fcH^fceN is bounded, and then (|3.5p readily follows. Let D := 
sup feeN {tfc} = ti > (indeed, (ifc)fceN is a decreasing sequence of positive numbers). Let us consider 
the rectangle R with vertexes 

inf{x : (x,y) G K} — Dy/2, inf{y : (x,y) £ K} - Dy/fj , 

inf{x : (x, y) £ K} - DV2, sup{y : (x, y) G K} + Dy/fj , 

sup{x : (x, y) eK}+ DV2, inf{y : (x, y) e K} - DV$\ , 

sup{x : (x, y) £ K} + D^2, sup{y : (x, y) G K} + Da/2") . 

Since ||Qfe|| = a/2, G N, if X n G if with some n G N, then X n+ i G -R, i.e., the recursion (13. lj) 
cannot leave the rectangle R starting from K by one step. Next we check that if X n G R with 
some n G N, then -X^+i G R, which yields that the recursion (|3.1|) cannot leave the rectangle R. 
We distinguish eight cases according to the Figure [5J If X n is in the rectangle numbered 1, then 



1 


2 


3 


4 




5 


6 


7 


8 



Figure 2: The eight cases. 
Qn+i = (—1, 1) T and hence, by the choice of D, 

X n +i — X n + t n+ \ G R. 

v-v 

If X n is in the rectangle numbered 2, then Q n +i = (1, 1) T or Qn+i = (— 1, 1) T according to the 
cases X { a ] > and X [ n ] < P^, and hence 

f-l\ ( 1 \ 

X n +i — X n + t n+ i G it! or X n+ i — X n + t n+ i G R. 

v-v v-v 

If X n is in the rectangle numbered 3, then Q n +i = (1, 1) T and hence 

f-l\ 

X n +i — X n + t n+ \ G R. 

v-v 

The other cases can be handled similarly. □ 
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